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Abstract — It has been widely observed that there exists a 
fundamental trade-off between the minimum (Hamming) dis- 
tance properties and the iterative decoding convergence behavior 
of turbo-like codes. While capacity achieving code ensembles 
typically are asymptotically bad in the sense that their minimum 
distance does not grow linearly with block length, and they 
therefore exhibit an error floor at moderate-to-high signal to 
noise ratios, asymptotically good codes usually converge further 
away from channel capacity. In this paper, we introduce the 
concept of tuned turbo codes, a family of asymptotically good 
hybrid concatenated code ensembles, where asymptotic minimum 
distance growth rates, convergence thresholds, and code rates 
can be traded-off using two tuning parameters, A and /i. By 
decreasing A, the asymptotic minimum distance growth rate is 
reduced in exchange for improved iterative decoding convergence 
behavior, while increasing A raises the asymptotic minimum dis- 
tance growth rate at the expense of worse convergence behavior, 
and thus the code performance can be tuned to fit the desired 
application. By decreasing /i, a similar tuning behavior can be 
achieved for higher rate code ensembles. 

Index Terms — concatenated codes, distance growth rates, 
EXIT-charts, Hamming distance, iterative decoding, turbo codes 



I. Introduction 

Turbo codes Q and multiple parallel concatenated codes 
(MPCCs) [2] perform very close to the Shannon limit with 
suboptimum iterative decoding, but the corresponding code 
ensembles are asymptotically bad in the sense that their 
minimum (Hamming) distance does not grow linearly with 
block length (3) . Even the minimum distance of the best 
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code in the ensemble of turbo codes cannot grow more 
than logarithmically with block length (4|. As a result, their 
minimum distance may not be sufficient to yield very low 
error rates at moderate-to-high signal to noise ratios (SNRs), 
and an error floor can occur. 

On the other hand, multiple serially concatenated code 
(MSCC) ensembles with three or more component encoders 
can be asymptotically good. This has been shown for repeat 
multiple accumulate codes in 0-Q. There also exist varia- 
tions of standard repeat accumulate codes that are asymptoti- 
cally good [8] but are more complex to encode than classical 
repeat accumulate codes. 

MSCCs in general exhibit good error floor performance due 
to their large minimum distance, but they have the drawback 
of converging at an SNR further from capacity than parallel 
concatenated codes. While the asymptotic distance growth 
rate of MSCCs can be made arbitrarily close to the Gilbert- 
Varshamov Bound (GVB) by adding more concatenation 
stages Q, the iterative decoding convergence behavior of the 
resulting code ensembles becomes worse, making codes with 
more than three concatenation stages impractical. 

An alternative to the above schemes are hybrid concatenated 
codes (HCCs), first introduced in [9]. They combine the 
features of parallel and serially concatenated codes and thus 
offer more freedom in code design. It has been demonstrated in 
|[T0l that HCCs can be designed that perform closer to capacity 
than MSCCs while still maintaining a minimum distance that 
grows linearly with block length. In particular, small memory- 
one component encoders are sufficient to yield asymptotically 
good code ensembles for such schemes. The resulting codes 
provide low complexity encoding and decoding, and, in many 
cases, can be decoded using relatively few iterations. In ifTTIl . 
the analysis of MSCCs and HCCs was extended to the binary 
erasure channel, and stopping set enumerators for the HCCs 
in ifTOll were derived. 

The HCCs presented in |[T0l consist of an outer MPCC 
serially concatenated with an inner accumulator. In this paper, 
we further elaborate on this code structure and extend the 
results of lTl2l to create a family of codes where the asymptotic 
minimum distance growth rate and the convergence threshold 
can be adjusted by varying a tuning parameter A. In particular, 
we replace a fraction 1 — A of the bits at the output of the 
inner accumulator with bits taken from the output of the outer 
MPCC (see Fig.Q]). This leads to a smaller asymptotic distance 
growth rate for decreasing A but also to a better iterative 
decoding threshold. The resulting code ensembles remain 
asymptotically good over the range of all positive values of A. 
We call this family of codes tuned turbo codes (TTCs). Tuning 
can also be used to vary the rate of the code. To this end, we 



introduce a second parameter //, A < // < 1, which denotes 
the fraction of bits that are kept from the combined output 
of the outer MPCC and the inner accumulator (see Fig. Q]). 
Related code structures have also been investigated in lfT3l . 

An advantage that TTC ensembles typically have over low- 
density parity check (LDPC) code ensembles is that tuning 
does not change the encoder structure. The iterative decod- 
ing convergence threshold of an LDPC code ensemble, as 
well as their asymptotic minimum distance growth rates, are 
determined by the degree distribution of the ensemble. To 
trade off the iterative decoding convergence threshold and 
the asymptotic minimum distance growth rate, one must vary 
the degree distribution, which in general results in a different 
encoder. 

For LDPC codes, quasi-cyclic code constructions are pre- 
ferred in practice since they can be encoded using a low com- 
plexity shift register encoder. The quasi-cyclic subensembles 
of LDPC codes, however, are not asymptotically good, since 
their minimum distances are upper bounded by a constant as 
the circulant sizes increase fT4ll . 

We note that the error floor performance of turbo-like codes 
with iterative decoding is greatly influenced but not solely 
determined by the minimum Hamming distance of the code, 
the subject of this paper, since pseudo-codewords and trapping 
sets also play a role. In Section|IIl we present a general encoder 
structure for TTCs and discuss the relevance of the minimum 
Hamming distance to designing codes with good error floor 
performance. We also introduce four specific types of TTCs 
that are the focus of our analysis throughout the remainder of 
the paper. In Section [Till we introduce ensemble-average weight 
enumerators for TTCs and their asymptotic expressions. In 
Section [iVl the ensemble average weight enumerators are 
used to bound the minimum distance for TTCs, and we 
present asymptotic minimum distance growth rates of TTCs 
for different values of A and \i. Also, a finite length minimum 
distance analysis is performed and the results are shown to be 
in agreement with the asymptotic results. Section W\ computes 
iterative decoding thresholds for TTCs using EXIT-charts, and 
Section [Vll combines the results of the previous two sections 
and addresses the tuning behavior of the code constructions. 
Finally, Section IVIII presents some simulation results, and 
Section IVIIII concludes the paper. 

II. Encoder Structure 

The general structure of the proposed tuned turbo codes 
is shown in Fig. Q] They consist of an outer MPCC serially 
concatenated with an inner rate-1 accumulator and optionally 
an additional rate-1 parallel encoder Co- The outer MPCC con- 
sists of a total of q rate-1 component encoders, Ci, C2, . . . , C q , 
of which the first J encoders, 3 < J < q, are recursive 
convolutional encoders (RCEs). The remaining q — J encoders 
in the outer MPCC are feedforward convolutional encoders 
(FFCEs). (We note that, while in practice it is not necessary 
to precede all component encoders by an interleave^ doing so 
simplifies the analysis and does not change the properties of 
the code ensemble.) We denote the combined output weight of 
the RCEs by h r = Yli=i h% anc * the combined output weight of 
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Fig. 1. General encoder structure for TTCs with feedforward and recursive 
convolutional component encoders. 



the FFCEs by h{ = Yli=j+i ^» where hi is the output weight 
of encoder d in the outer MPCC. The total output weight of 
the outer MPCC h n is given by h p — h r + h{ — X^?=i hi- 

The output of the outer MPCC enters the serially concate- 
nated inner accumulator, whose output weight is denoted by 
h s . Both the output of the outer MPCC and the output of the 
inner accumulator are punctured, then multiplexed together 
and passed to the channel. The puncturing rates (/i — A) 
and A in Fig. [T] denote the fraction of bits that survive after 
puncturing the outer MPCC and the inner accumulator, and 
h f p and h' s are the corresponding weights, respectively. Finally, 
h = h' s + h' p + ho represents the total output codeword weight. 

The parameter fi is used to control the rate of the TTC 
ensemble, i.e., considering the multiplexed output of the outer 
MPCC and inner accumulator, a total fraction of /i bits survive 
puncturing. The rate of the overall ensemble is thus given by 

K 1 0) 



R 



N 



where K is the input length, N is the total output length, and 
2o = 1 if there is an additional parallel encoder and Xq = 
otherwise. As additional parallel encoders we consider FFCEs 
or simply a systematic branch. 

Tuning the asymptotic minimum distance growth rate and 
the iterative decoding convergence threshold is done by vary- 
ing the puncturing rate A, i.e., changing the fraction of bits 
that come from the output of the inner serially concatenated 
accumulator. For A = 0, all the bits of the inner accumulator 
are punctured and the output is the (possibly punctured) output 
of the MPCC. For A = fi on the other hand, all output bits of 
the tuning section stem from the inner accumulator and none 
of the bits of the outer MPCC survive puncturing. 

In the sections of the paper that feature numerical results, 
from Subsection IIV-BI onwards, we consider four different 
types of TTCs, which are depicted in Fig. [2] For each type, 
we consider a version with only 2- state component encoders 
and a version with 4- state RCEs in the outer MPCC. All types 
are based on the rate R = 1 /4 HCCs introduced in |[T0l and, 
for A = fi = 1, are identical to the HCC in [10], while for 
A = 0, we obtain the (possibly punctured) outer MPCC plus 
the optional parallel encoder. 

The type 1 and 2 TTC ensembles have a rate R = 1 /4 outer 
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Fig. 2. Encoder structure for different TTC types with feedforward and recursive convolutional component encoders (FFCEs and RCEs, respectively). 



MPCC with no additional parallel encoder Co (see Fig. O. 
While the outer MPCC of the type 1 ensemble consists of 
four identical rate-1 RCEs, the last encoder C4 of the MPCC 
in the type 2 ensemble is the 2- state FFCE having generator 
[3] s (in octal notation). The type 3 and 4 TTC ensembles have 
a rate R = 1/3 outer MPCC consisting of three identical rate- 
1 RCEs plus an additional parallel encoder Cq. In the type 3 
ensemble, Co is the [3] 8 FFCE, while in the type 4 ensemble 
it is simply a systematic branch. Thus, for /i = 1 and A = 0, 
when the output of the outer MPCC is not punctured and all 
bits from the inner encoder are punctured, the type 2 and 3 
code ensembles are identical, while they differ for all other 
values of /i and A. The outer MPCC of the type 2 ensemble 
(with 2- state encoders) was introduced in lf]~5l and exhibits 
excellent iterative decoding behavior due to the presence of 
the FFCE (see lfT6l ). In all the cases considered in this paper, 
the 2-state rate-1 RCEs are accumulators with generator [1/3] g 
and the 4-state RCEs are chosen to have the generator [5/7] g. 

We decode TTCs iteratively, in a component code oriented 
fashion, which is a generalization of the turbo-decoding prin- 
ciple applied in [lj. Component decoders employ maximum 
a posteriori probability (MAP) decoding strategies and the 
extrinsic information of one component decoder becomes a 
priori information for the other decoders. In our simulations 
we assume a straightforward iteration schedule, where each 
component decoder is activated once per iteration. 

Since we use iterative decoding and not a MAP decoder 
for the overall code, the performance of the decoder in the 
moderate-to-high SNR region of the additive white Gaussian 
noise (AWGN) channel is greatly influenced but not solely 
determined by the minimum Hamming distance of the code. 
Pseudo-codewords and trapping sets also play a role in the 
error floor performance of the decoder (see, e.g. ifTTIl . ifTTl ). 

TTC ensembles with 2-state component encoders are closely 
related to LDPC codes and can also be decoded using the sum- 
product algorithm fT8lh so it is likely that the pseudo-weight 



properties of TTCs are similar to those of LDPC codes. In |[T9l 
it was shown that the minimum AWGN channel pseudo-weight 
of regular LDPC codes grows at best sub-linearly with block 
length, even though the minimum Hamming distance grows 
linearly with block length. There exist, however, specially con- 
structed code ensembles where the minimum binary symmetric 
channel pseudo-weight can grow linearly with block length 
HH. 

Since the minimum Hamming distance is an upper bound on 
the minimum pseudo-weight, we expect that designing TTC 
ensembles whose minimum distance grows linearly with block 
length will lead to code ensembles that also possess good 
pseudo- weight properties. This expectation is supported by 
the finite length (Hamming) distance analysis in Section [TV] 
and the simulation results in Section IVII1 both of which show 
that code ensembles with large minimum Hamming distance 
exhibit low error floors. 



III. Preliminaries 



A. Weight Enumerators 

The weight spectrum of an (TV, K) linear encoder C(N) is 
described by its weight enumerator (WE) A^ N \ which speci- 
fies the number of codewords with output weight h. Likewise, 
let A^j^ denote the input-output weight enumerator (IOWE), 
which specifies the number of codewords with input weight w 
and output weight h. To investigate the distance properties of 
tuned turbo code ensembles, we consider the ensemble average 
of the above quantities. For an encoder ensemble C(N) of 
length N, we write the average IOWE as 



tC(7V) 1 

w ' h " |C(AT)| 
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where |C(iV)| denotes the size of C(N). When the members 
of C(N) are equally likely, we obtain the average WE as 



JC(7V) 



C(N) 
h • 



(3) 



The average WE represents the expected number of codewords 
of weight h if a code is randomly chosen from the ensemble 
C(N). In the rest of the paper, whenever the context is clear, 
we will omit the parameter N. 

To obtain the average WE I^ TTC ^^ of TTC ensembles, 
we use the uniform interleaver analysis introduced in |2H . 
The uniform interleaver is a probabilistic device that maps an 
input block of weight w and length Kc into all its possible 
(^ c ) permutations with equal probability, thus decoupling the 
component encoders in a concatenated code and creating a 
code ensemble with equally likely members. An (Nc,Kc) 
component encoder C(Nc), preceded by a uniform interleaver, 
results in the input-output weight distribution (IOWD) 



j)C(Nc) 
' w.h 



C{N C ) 
h 
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(4) 



where F^^ c ^ is the probability that encoder C(Nc) transforms 
an input of weight w into an output of weight h. For (Nc,Nc) 
2-state component encoders, the IOWE can be given in closed 
form as d 



.Acc(7V c ) _ A FF(N C ) 



N c -h\( h-1 
[w/2\ J \\w/2] - 1 



(5) 



where w/2 < h < Nc — w/2, "Acc" represents the accu- 
mulator, and "FF" represents the 2-state FFCE with generator 

[3]s. 

In the case of TTCs, component codes may be punctured. 
The IOWE of punctured accumulators was analyzed in l23l 
by considering the serial concatenation of an accumulator 
and a single-parity-check. Using this approach, only regular 
puncturing patterns and puncturing rates of A = 1/i with 
i G N can be realized. To be able to vary A continuously, we 
therefore consider random puncturing, and the code ensembles 
we analyze are formed over all interleaver realizations, as 
well as over all possible puncturing patterns. Using random 
puncturing, the probability that a codeword of length N and 
weight h before puncturing is punctured to a codeword of 
length N f = XN and weight h! is given by the hypergeometric 
distribution 

(N'\ (N-N'\ 

3 (jv") _ U/A h-w ) 



h.h'.X 



(6) 



where © represents the IOWD of the random puncturing 
operation and we require h! < N f , h — h' < N — N' , 
and h! < h. Throughout the paper we define the binomial 
coefficient (™) to be zero if n < k. 

The average component input-output weight enumerator 



(CIOWE) of an (N, K) TTC, A 



Cttc (N) 

w,ho,hi,...,h q ,h s ,h' p ,h 



,, is the 



average number of codewords with fixed input and output 
weights w, ho : hi, . . . , h q , /i s , h f p , and h f s of each component 
encoder in the TTC. The CIOWE is simply the product of the 



IOWDs of the components times the number of permutations 
of the input sequence, i.e., 

jCttc(^) 
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n 2 MK)\ m p Acc(gK) _ p P(gK(/x-A)) 
w,hi J h p ,h s h p ,h p ,fjL-X 
i=0 / 
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where we denote the total output weight of the outer MPCC 
as h p = Yli=i hi- If there is no additional parallel encoder, 



we define 



bo(K) 
w,ho 



to be one for ho = and zero otherwise. 



The ensemble average IOWE of a TTC, A 



Cttc (N) 
w,h 



IS 



then the summation over all CIOWEs such that the codeword 
has weight h. To include the total output weight h in the 
CIOWE, we represent the punctured weight of the inner serial 
accumulator as h' s = h — h' — ho, thus obtaining the IOWE 
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w,h 
K 



K qK 
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(8) 



h q ,h s ,h' p ,h' 



h =X hi = l 



= 1 h s =l h'=0 



Note that, with random puncturing, it is possible that all 
the weight is punctured and therefore the enumeration of 
punctured weights starts at zero. 

B. The Spectral Shape 

To investigate the asymptotic minimum distance properties 
of tuned turbo codes as the block length N tends to infinity, 
we will make use of the asymptotic spectral shape function 
originally introduced by Gallager ll24l . 

\nA C{N) 

r(p)=limsup (9) 



where p = is the normalized codeword weight. The spectral 
shape is the exponential part of the average WE normalized 
by the block length TV. When r(p) < 0, the average number 
of codewords with normalized weight p goes exponentially to 
zero as N tends to infinity. When r(p) > 0, on the other hand, 
the average number of codewords with normalized weight 
p grows exponentially in N. When r(p) = 0, the average 
number of codewords with normalized weight p does not 
exhibit exponential growth — it might increase or decrease 
poly normally, for example. 

Similarly, we define the asymptotic IOWD of an (Nc, Kc) 
component code C(Nc) as 



f 

J oc. 



lnF C{Nc) 
lim - L«*cJ,l/w c J 
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N c 



(10) 



where a and /3 are the normalized input and output weight 
w.r.t. the input block length Kc and the output block length 
Nc, respectively, of code C(Nc). Stirling's approximation can 
be used to bound the binomial coefficients as 

nW{k/n) 

(11) 



where EI (x) = — x In x — (1 — x) ln(l — x) denotes the binary 
entropy function using the natural logarithm. 
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Using ©, (0), (0, and £□} the asymptotic IOWD of the 
accumulator is given by 



fiS = (i-«n 



[(«), (12) 



where a = w/Nq and f3 = ft/iVc (see also 0). In the same 
way, the asymptotic IOWD of the 2- state FFCE is given by 



/^ = (l-a)H 



, all — 
2(1 - a) y \2a 



:(<*)■ (13) 



Similarly, by using ©, dTUb . and ([TTlh the asymptotic IOWD 
of the random puncturing operation is given by 

l-X^fP-Xp^ _ 1 



/| l ^ l A=H(^) + ^Hl^-f^)-^HC8), (14) 



where /3 = ft/7V c and /3' = ti/(\N c ). 

We now define the asymptotic CIOWE of an (TV, K) TTC 

as 

i iCttc(^) 

where a = w/K, pi = ft;/ K, i = 0,1, ... , p s = ft s / (gif)* 
Pp = ftp/(9(M - A)if), and p = ft/(g/i + ^o)^ = h/JV. 
Using ([I5i we rewrite the asymptotic spectral shape as the 
optimization problem 



r(p) = sup 



r. 



Cttc 
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We obtain the asymptotic CIOWE of a TTC by inserting its 
CIOWE © into (fT5l) . The logarithm transforms the product of 
IOWDs in (|7]) into a sum, and in the limit as the block lengths 
of each component code Nc t tend to infinity, the asymptotic 
CIOWE of a TTC can be written in terms of the asymptotic 
IOWDs of its component codes, weighted by their respective 
block lengths divided by TV, as 



TT^TTC 

Oi,po,pl,...,p q ,p s ,p' p ,p 



Acc 

Ps 



(17) 



where p p = h v /qK and R = K/N is the rate of the 
TTC given by ©• To include the normalized total output 
weight p = h/N in the asymptotic CIOWE, we represent the 
normalized punctured weight of the inner serial accumulator 



Ps aS 



h-K 



h 



qXK qXK 
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(18) 



If there is some p > such that r(p) < for all < p < p, 
we would immediately have that p is the asymptotic growth 
rate of the minimum distance of the ensemble. However, this 
is not the case for TTCs. 

Proposition 1. For < p < RqX, the spectral shape of a 
TTC cannot be negative but is lower bounded by r(p) = 0. 



Proof: The proposition is trivially proved by setting p p — 
(which implies a = 0, po = 0, pi = for i = 1, . . . , q, and 
Pp = 0) and p s = p f s = p/(RqX). Setting p p = results 
in the asymptotic IOWDs of the 2-state component encoders 
(P , (fT3l) in the CIOWE of a TTC to be zero and setting p s = 
p' s results in the asymptotic IOWD of the random puncturing 
operation (ITU) to be zero, resulting in 

tCttc n 

^0,0,0, ...,0,(p/(RqX)),0,p ~ u - 

■ 

Thus, it cannot be directly concluded that the resulting en- 
sembles are asymptotically good, but we will show in the next 
section that the 2-state ensembles are indeed asymptotically 
good and we conjecture the same for the 4- state ensembles. 

IV. Minimum Distance Analysis 

In this section we make use of the expressions from the 
previous section to perform both an asymptotic and a finite 
length minimum distance analysis of tuned turbo codes with 
2-state component encoders. 

A. Asymptotic Analysis 

For a TTC with q encoders and J accumulators in the outer 
MPCC (see Fig. Q]), the probability that a randomly chosen 
code from the ensemble has minimum distance d m { n < d is 
upper bounded by 

d-l 

P (dmin < d) < (^ TTC W - 1) + J2 A^ TciN) (19) 
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(20) 

Note that, while the average number of all-zero codewords 
A^ N ^ equals 1 for unpunctured linear codes, with punctured 
codes there is a possibility that all the weight is removed by 
the puncturing operation. We take the probability of this event 
into account with the term (i^ TTC ^^ — 1) in (fT"9l) and with 
the summation over h starting from zero in (l20b , while the 
summation over w starts at w = 1. 
We define the value p as follows. 

Definition 1. Let < p < RqX/ 2 be such that, for all < 
p < p, the unique supremum of the asymptotic CIOWE of TTCs 
given by (TT7T) is achieved for p p = and p s = p' s = p / (RqX). 

Following the procedure established in l25l and Q, we can 
split (l20l) into two parts, A\ and A2, depending on the output 
weight of the outer MPCC h p = J2i=i hi- F° r an Y positive 
integer h*,q<h*< Kq, we can write 

F(d min <d) = 

p (^min < d n hp < ft;) +p (d min < d n ft p > ft;) . (21) 



h s ,h',h' 



We now proceed to show that, with appropriately chosen 
values of ft; and d, A 1 and A 2 -» as N 00 for all 
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d < \N(p — e)~|, where e > is an arbitrarily small constant, 
which implies that the ensemble is asymptotically good with 
asymptotic minimum distance growth rate p. 



Lemma 1. As N 

have 



oo, for all J > 2 and h* < N 



J-2 
J 



A x = P (d min < \N(p - e)l H ftp < ft;) (22) 
/6>r arbitrarily small values of e > 0. 

Proof: Using the simple upper bound 

Ai =P (d min < \N(p - e)l H ft p < ft;) 

< p (ftp < ft;) , 

the problem is reduced to finding the asymptotic minimum 
distance of an MPCC with J parallel concatenated RCEs, 
which was lower bounded in O and |[25l as 

P (ftp < 7V^- e ) < d • N~ e/2 

for arbitrarily small values of e > 0, some positive constant 
Ci, and N sufficiently large. ■ 
Now, considering A2, we upper bound the q + 5 sums in 
(l20l) by their maximum element times A'.Rg + 1, which is an 
upper bound on the number of terms in each sum, and we 
obtain 

A 2 =P (d min < \N(p - e)l n ftp > ft;) 



<(NRq + l) 



4+5 



max 

Eii^p>^; 

/i<TiV(p-e)l 
w,h ,h'h s 



A 



Cttc (N) 

w,ho,hi,...,h q ,h s ,h' p ,h' 



(23) 

Using Stirling's approximation JTTT) . we can upper bound 
each of the q + 4 IOWDS in the CIOWE of © as 

< exp {NcJ^ + 2 \n(N Ci + 1)} . 

Then using the notation of the asymptotic CIOWE (ITTb and 
upper bounding Afc. + 1 by A'.Rg + 1, we obtain (l24l) . 

Thus, to bound A2 it is necessary to examine the asymptotic 
CIOWE and the asymptotic spectral shape (fT6l) of TTCs. We 
now show that if there exists a p > as defined in Definition Q] 
we have A2 —> as A 7 ' —> 00. To this end we make use of the 
log-concavity of the IOWDs of the component encoders. 

Proposition 2. It holds that: 

1) For a fixed input weight w, the IOWD P^^^ of the 
accumulator forms a logarithmically concave sequence 
in the output weight ft and its maximum occurs at ft = 
Nc/2. 



2) For a fixed input weight w, the IOWD F^J h (Nc) of the 
2-state FFCE forms a logarithmically concave sequence 
in the output weight ft and its maximum occurs at ft = 
2w(l-w/N c ). 

3) For a fixed input weight ft, the IOWD P^^Tj| of the 
random puncturing operation forms a strictly logarith- 
mically concave sequence in the output weight ft/ and 
its maximum occurs at ft/ = Aft. 

The proofs of these statements can be found in Appendix lAl 
From Proposition [2] it follows that, for a fixed input weight w 
and a fixed total output weight of the RCEs ft r = ^2^ =1 hi (see 
Fig. the CIOWE of TTCs is maximized when the RCEs 
in the outer MPCC contribute equally to ft r , i.e., when hi = 
h r /J, or pi = h r /JK = p r , i G {1, . . . , J}. Equivalently, the 
CIOWE of TTCs is maximized when the FFCEs in the outer 
MPCC contribute equally to ftf, i.e., when hi = hf/(q — J), 
or pi = hf/(q — J)K = pf, i £ { J + 1, . . . , q}. Thus we can 
substitute p s and pi for the pi in the asymptotic CIOWE and 
the number of variables in the maximization problem in (l24l) 
is reduced. The normalized output weight of the outer MPCC 
is then given by p p = (Jp s /q + (q - J)pt/q). 

Lemma 2. If there exists a p > then for J > 2 RCEs in the 
outer MPCC and 

lim ln(A^ + l) =Q 



h* 



we have 



A 2 = r (d min < \N(p - c)] n ftp > ft;) ^ 

as N — >• 00, where e > is an arbitrarily small constant. 

Proof: We investigate the asymptotic CIOWE dT71) in the 
region < p < p by splitting it into two parts, RqF\ and 
RqF 2 , and write 



fcp fa s 



= NRq(F 1 +F 2 ) 



N R ' ATH' N RJ ' NR(q-J)> N Rq ' NRq(/j,-\)> N 



with 



Fi — -EE (— — ) + — / C ° h H — /^ cc h r 
q \NR/ q wr, wk q ivr' ivhj 

1 Q ~ J rFF 1 I'ACC 



(25) 



(26) 



JVH' NR(q-J) N Rq ' N Rq 



F 2 = ( M -A)/P 



N Rq ' N Rq(fj, — X) ' ^ ^ N Rq ' N RXq 

The term Fi includes the asymptotic IOWDs of the encoders, 
whereas F2 includes the asymptotic IOWDs of the random 



■A/ . fa-fa' -fan . • ( 27 ) 



A 2 <(NRq + 1) 9+5 exp <( 



max AT • F C 

fa P >fa;,fa< Wp-oi 

w,ho,h' ,h s 



- exp < max 

fa p >fa*,fa<r^(p- e )i 

w,hQ,h' ,h, 



a--f Ct 



N R ' ATK ' A^fiq ' 



faQ fal 
N R ' N R ' ATKq ' 



(2q + 8) ln(NRq + 1) 



N Rq ' N Rq ' NRq(fJt-\)> N 



N Rq N Rq ' 7VHq(/x- A) ' AT 



(3g + 13) ln(A^i?g + 1) 



(24) 
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puncturing operation. From Definition \T\ we have that, for < 
p < p, the spectral shape has its supremum at r(p) = 0, which 
is achieved for p p = and p s = p' s = p/(Rq\). 

First we note that F 2 < 0, with F 2 = for p s = // s and 
F2 < otherwise (see the proof of part 3 of Proposition [2]), 
so we can simply upper bound the term NRqF 2 by zero. 

Next we note that F\ tends to zero for p p —> (see the proof 
of Proposition [U, and hence to upper bound NRqFi we con- 
sider all possible ft p > ft* such that p p tends asymptotically 
to zero, i.e., 



lim ^7 

N^oo N 



0. 



Then we have 



lim NRq F 1 

N^oo 
h p /N^0 



lim 

TV^oo 
h p /N^0 



Fi 
Pp 



-Co 



(29) 



for some positive constant C 2 and for p s < 1/2. 

So, for p p = 0, from ©, d25]), 426k (|27]), CS, and <|29j 



we can write 



^2 < exp {-C 2 ■ ft p + (3<? + 13) ln(JVity + 1)} 



(30) 



and lim^^oo A 2 = for 
Hindoo \n(NRq + l)/ft* = 0. 



all ft* that satisfy 



Remark 1. The fact that in Appendix\B\we require p s < 1/2 
for ([29b to negative together with the fact that we require 
p s = p' s = pj (RqX) for F 2 to be zero results in the upper 
bound on the asymptotic minimum distance growth rate 



P< 



RqX 



(31) 



given in Definition^ 



We summarize our results in the following Theorem. 

Theorem 1. If there exists a p > as defined in Definiton [7] 
for a 2-state TTC ensemble with J > 2 RCEs in the outer 
MPCC, then the 2-state TTC ensemble is asymptotically good 
and the asymptotic minimum distance growth rate is at least 
P- 

Proof: From Lemmas Q] and [2 we have that, for an 
arbitrarily small constant e > 0, both 



and 



1 (dmin < \N(p - e)l n ftp < hi) -+ 

' (dmin < \N(p - e)l H ftp > ft;) ^ 




2-St. Type 2 2-St. Type 1 4-St. Type 3 
p = 0.1793 || p = 0.1911 = 0.2021 



Random Codes 
R=1/4 



(28) 

where both F 1 and p p = h p /(NRq) tend asymptotically to 
zero as N — >> oo and the fraction F\ / p p is the difference as TV 
quotient of the point Fi\ Pp= o, which as TV —> oo yields the 
total derivative of F\ with respect to p p evaluated at p p = 0. 

We show in Appendix [B] that, if there exists a p > 0, then, 
for J > 2 accumulators in the outer MPCC, the total derivative 
of F\ with respect to p p evaluated at p p = is bounded by 



Fig. 3. Asymptotic spectral shapes for the rate R = 1/4 TTCs with n 
A = 1. 



lim 



oo for any ft* satisfying 
\n(NRq+l) _ n 



hi 



and ft; < N 1 ^- 



Theorem[T] proves that p is a lower bound on the asymptotic 
minimum distance growth rate of a 2-state TTC ensemble. In 
a slight abuse of notation, from now on we refer to p as the 
asymptotic minimum distance growth rate. 

B. Asymptotic Minimum Distance Growth Rates 

While the spectral shapes of TTCs cannot be negative, the 
existence of a positive p according to Definition [T] implies 
that the ensemble is asymptotically good. As is common 
practice, we numerically evaluate the spectral shapes of TTC 
ensembles and use a subspace trust-region method l26l to 
evaluate the supremum of the asymptotic CIOWE. For 2- 
state component codes, the asymptotic IOWDs are available 
in closed form, but for 4-state ensembles, we cannot obtain 
closed form expressions, so to compute the asymptotic spectral 
shapes we use the method outlined in l27l to calculate them 
numerically. 

Fig. [3] shows the asymptotic spectral shapes for the rate 
R = 1/4 TTC ensembles with p = A = 1, i.e., the spectral 
shapes of the HCCs. The asymptotic spectral shape function of 
the entire ensemble of block codes is also shown. It crosses 
zero at the GVB for rate R = 1/4. The ensembles with 2- 
state RCEs in the outer MPCC are plotted with solid lines, 
while the ensembles with 4-state RCEs in the outer MPCC 
are plotted with dashed lines. The spectral shapes are never 
negative, but they start out with a zero stretch and turn positive 
at the asymptotic distance growth rate p. 

Among the 2-state ensembles, the type 1 scheme has the 
largest asymptotic distance growth rate of p = 0.1911. 
Replacing one of the parallel concatenated accumulators by its 
feedforward inverse (type 2) decreases the asymptotic distance 
growth rate to p = 0.1793. When only three branches enter 
the inner serially concatenated accumulator and the output 
of the 1 + D branch is sent straight through to the channel 
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Fig. 6. Lower bound on the minimum distance of the R = 1/4 type 2 
Fig. 4. Asymptotic minimum distance growth rates of the type 1 TTC as TTCs with 2 " state component encoders (filled markers) and 4-state component 
the tuning parameter A varies, < A < /z. In each case, the GVB is drawn encoders (empty markers) for /x = 1, e = 1/2, and different values of the 
only up to A = /x, the maximum possible value of A. tuning parameter A. 



Type 4 




= 1, R = 1/4, 2ST 
-H = 2/3, R = 1/3, 2ST 
li= 1/3, R = 1/2, 2ST 
-H = 1, R = 1/4, 4ST 
-11=2/3, R = 1/3, 4ST 
- jx = 1/3, R = 1/2, 4ST 



Fig. 5. Asymptotic minimum distance growth rates of the type 4 TTC as 
the tuning parameter A varies, < A < /j. In each case, the GVB is drawn 
only up to A = /i, the maximum possible value of A. 



(type 3), the asymptotic distance growth rate reduces further 
to p = 0.1276, and for the systematic type 4 scheme we obtain 
an asymptotic distance growth rate of only p = 0.1179. 

Employing 4-state [5/7] g codes instead of accumulators in 
the outer MPCCs increases the asymptotic distance growth 
rates w.r.t. the 2-state ensembles. In the case of the type 
1 and type 2 ensembles with 4-state encoders in the outer 
MPCCs, the positive part of the asymptotic spectral shape 
is practically indistinguishable from the spectral shape of the 
entire ensemble of block codes. 

Fig. IH shows the asymptotic minimum distance growth 
rates p of the type 1 TTC as the tuning parameter A varies, 
< A < /i. As the code rate increases by reducing the 
coefficient p, the initial slope of the asymptotic distance 
growth rate curve becomes steeper. For small A, these curves 
approach the upper bound on p given by (|3TT) and indicated by 
the line p = ^ for the type 1 ensemble. This steep increase 
in the asymptotic distance growth rates with A is followed 
by the curve flattening out as the asymptotic distance growth 



rates approach the GVB. The green curve for the rate R = 1/2 
code ensemble shows the steepest increase (among the curves 
shown) but then flattens out around A = 0.15. Like the 4-state 
code ensembles it reaches the GVB for A = p. The asymptotic 
distance growth rates of the type 2 tuned turbo code show the 
same general behavior, but they are smaller than those of the 
type 1 ensemble and the increase for small A is not as steep. 

Type 3 and 4 TTCs also show the same general behavior, 
with the asymptotic distance growth rates of the type 3 
ensemble being slightly larger than for the type 4 ensemble. 
The asymptotic distance growth rates of the type 4 ensemble 
are shown in Fig. \5\ The initial slope of the curves is smaller 
than for the type 1 ensemble, and for A = p the asymptotic 
distance growth rates are further away from the GVB. They 
also increase more smoothly with A than for the type 1 
ensemble. 



C. Finite Length Analysis 

The minimum distance of a TTC ensemble for a finite block 
length N can also be analyzed using dT9b . In particular, if we 
set P (d m in < d) = e, where e is any positive value between 
and 1, we expect that at least a fraction 1 — e of the codes in 
the ensemble have a minimum distance d m { n of at least d. In 
the following, we choose e = 1/2, i.e., we expect that at least 
half of the codes in the ensemble have a d m i n at least equal 
to the value predicted by the curves. 

In Fig. [6] we show the lower bound on d m i n versus the code 
block length N for the R = 1 /4 type 2 tuned TTC ensembles 
with 2- and 4-state component encoders and several values 
of A. The finite length GVB is also plotted for reference. 
The results are consistent with the asymptotic analysis in 
the previous section and show increasing minimum distance 
growth rates with increasing values of A. Also, for a given 
value of the tuning parameter A, the minimum distance of 
the type 2 code ensemble with 4-state component encoders 
is larger than for the code ensemble with 2-state component 
encoders. 
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Fig. 7. Lower bound on the minimum distance of the R = 1/2 type 4 
TTCs with 2-state component encoders (filled markers) and 4-state component 
encoders (empty markers) for = 1/3, e = 1/2, and different values of the 
tuning parameter A. 



In Fig. [7] we display the same set of curves for the R = 1/2 
type 4 TTCs with 2- and 4-state component encoders. Again, 
the results are consistent with the asymptotic analysis, and for 
a given value of the tuning parameter A, the minimum distance 
of the code ensemble with 4-state component encoders is 
larger than for the code ensemble with 2-state component 
encoders. 

For 4-state RCEs we cannot obtain a closed form WE. 
However, since 2-state TTCs are asymptotically good, and 
replacing the accumulators in the outer MPCC with more 
complex [5/7] s RCEs increases both the asymptotic distance 
growth rates (see Figs. [3]|5]) as well as the finite block length 
minimum distances (see Figs. [6] and [7]), we strongly conjecture 
that the resulting code ensembles with the same structure are 
still asymptotically good. 

V. Iterative Decoding Convergence Threshold 

To determine the iterative decoding thresholds of tuned 
turbo code ensembles we employ an extrinsic information 
transfer (EXIT) chart-based analysis [28]. EXIT charts track 
the exchange of extrinsic information between component de- 
coders in a concatenated code scheme to estimate its iterative 
decoding threshold. In the following we briefly describe EXIT 
charts for type 1 TTCs. The decoder is depicted in Fig. [U 
A similar procedure as the one described below can also be 
applied to type 2, type 3, and type 4 TTCs. 

Let Ui = (u , • • .,u KCi -i) and x i = (#o, • • -,x NCi -i) be 
the sequence of information symbols and the sequence of code 
symbols, respectively, of the ith (N^ , Kc i ) component code 
Ci of the TTC. (In the following, we will drop the index i 
when referring to a generic component code.) Each component 
decoder in Fig. [8] is fed with a priori information (from either 
other component decoders or the channel) on its information 
and coded symbols and computes extrinsic information which, 
in turn, is used by the other component decoders as a priori 
information. In convergence analysis using EXIT charts it is 
common to model the a priori information as a Gaussian 
random variable. Also, as required in EXIT charts analysis, 



we assume that Kc — » oo and Nq — >• oo. For information 
symbol u the corresponding a priori L- value (or log-likelihood 
ratio) is denoted by L%(u). Using the Gaussian approximation, 
L%(u) can be expressed as: 



L A U ) = —u + w 



(32) 



where w is a zero-mean Gaussian random variable with vari- 
ance g\ u . We denote by I(u; L%(u)) the mutual information 
(MI) between u and L%(u). The average a priori MI for the 
information symbols is 



I c = 



K c 



Kc-l 

E 

2=0 



I(ui;L c a ( Ui )), 



(33) 



which depends only on cr a?n and can be computed using the J 
function as if = J(cr a?M ) l28l . Note that if u is transmitted 
over the (binary-input Gaussian) channel, L% (u) corresponds 
to the channel L-value, £ c h(u) = 4i?7r, where R is the 
code rate, 7 denotes the SNR E^/No, r = u + n is the 
received observation, u is the BPSK modulated symbol, and 
n is AWGN with variance No/2. In this case it can be easily 
shown that g\ u = 8Rj. 

For code symbol x, the corresponding a priori L-value is 
denoted by L^(x). Using the Gaussian approximation L^(x) 
can be written as 



-x + w. 



(34) 



where w is a zero-mean Gaussian random variable with 
variance o\ x . As before, we denote by I(x;L^(x)) the MI 
between x and L%(x). The average a priori MI for the code 
symbols is given by 



1 



Nc-l 

E 

2 = 



I{xi\Ll{xi)), 



(35) 



which can be computed using the J function as if x = J(cr^ x ). 
If the code symbols are transmitted over the channel, o\ x = 
SRj. 

The a priori L- values L%(u) and L^(x) are inputs to an 
a posteriori probability (APP) decoder which computes the 
extrinsic L-values L%(u) and L^(x) for information symbols 
and code symbols, respectively. The extrinsic L-values are 
also Gaussian with variance o\ u and a% x , respectively. The 
average extrinsic MI for information and code symbols is given 
by 



1 Kc-l 

C 2 = 



and 



1 Nc-l 

— I{xi]L c e {xi)), 



(36) 



(37) 



respectively. 

The input-output behavior of the APP decoder for encoder C 
is completely characterized by two EXIT functions, T u and T x , 
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which specify the evolution of the extrinsic Mis as a function 
of the a priori Mis: 



(Ml 

TC 



^i(4,u5 ^a,x) 



(38) 



In practice, these functions can be obtained by Monte Carlo 
simulation for all values < if u < 1 and < if x < 1 by 
modeling the a priori information as Gaussian distributed, as 
noted above. 

The decoder of the type 1 TTC consists of q + 1 APP 
component decoders C^ 1 , . . . , C~, and C~^ c corresponding to 
the component encoders C\ , . . . , C q of the outer MPCC and to 
the inner accumulator, respectively, which iteratively exchange 
extrinsic information (see Fig. [5]). A decoding iteration consists 
of a single activation of Cf , . . . , C" 1 and C~ c ]. in this order. 
The evolution of the extrinsic MI can then be tracked in a 
multi-dimensional EXIT chart |29l , which plots together the 
EXIT functions of the q + 1 component encoders and can 
be used to predict the convergence threshold. Unfortunately, 
such a multi-dimensional EXIT chart is hard to visualize. 
To generate EXIT charts that are easier to deal with, the 
EXIT functions of the component encoders of the outer MPCC 
can be combined to obtain the EXIT function of the MPCC, 
without any precision loss in the prediction of the convergence 
thresholds [30]. In this way, the behavior of TTCs can be 
determined by using a two-dimensional EXIT chart, displaying 
in a single figure the EXIT functions of the outer MPCC and 
of the inner recursive encoder: 



tCmPCC rp ( tCmPCC 

1(1 — - ^V^XMPCC 



e,x M pcc 

pC&,cc 
6, Uacc 



) 



r p ( 7"^acc 7"^acc ^ 

_ -^nV^Uacc' i a,X acc y 



(39) 



whprp /"^mpcc 

Wfiere VxmPCC 



P^acc 
G,Uacc 



and ir^c 

<*5 u acc 



rC M pcc Note 
i e,x M pcc' iNULe 



that, since the inner accumulator is connected to the channel, 
I& xLc * s a f unc ti° n °f 7- m particular, we must distinguish 
between the MI corresponding to the parity bits generated by 
the accumulator and the MI corresponding to the input bits, 
since the two branches are punctured with different puncturing 
rates. Assuming random puncturing, the a priori MI for the 
parity bits of the inner accumulator, punctured with rate A, is 
given by XJ(^8Rj), while the a priori MI provided by the 
channel for the input bits of the inner accumulator, punctured 
with rate /i— A, is (jj J — X)J(^/SRy). With these considerations, 
the EXIT function of the inner accumulator can be written as 



p^&cc 
6, Uacc 



Cmpcc 
e,XMPCC ' 



) ,(AJ(V / 8^),(/i-A)J(V / 8^)))- 

(40) 

What remains is the computation of xmpcc Looking in 
more detail at the EXIT functions of the component encoders 
of the outer MPCC, we observe that the /th, I = {1, . . . , 4}, 
component decoder is fed with a priori information on ui 
generated by all the other component decoders of the MPCC, 
and with a priori information on x/ provided by the decoder 
of the inner accumulator. The EXIT functions of the Ith 




Eh 



l£ acc (u aC c) 



EH 



^ acc (xacc) 



if acc (uacc) 



^ 3 (»i)pr^fe 3 (u 3 ) 

4^ 4 (ui)| lig*. 

Lg 4 (ui)pr^ 4 (u 4 ) 
Fig. 8. Decoder for a type 1 TTC. 



component of the outer MPCC can then be expressed as 




4% = t c x > I J 



(41) 



for information symbols and code symbols, respectively. 
In gB we used the fact that L%(u) = E^z^e'W 
and (assuming independence) al Ui = J2i^i a e,Ui^ f rom 
which (using the J function) it follows that I^ Ui = 




281 . Note that, for the type 

1 tuned turbo code, the four EXIT functions if l Ui and if z Xz 
are identical and /?< , = . The EXIT function I^ c ° 

a-i-X-l ti,Uacc c,XMPCC 

can be computed for all values < if ^ < 1 by activat- 
ing all q decoders of the MPCC until if l Ui and if z Xz have 
converged to a fixed value. In other words, to obtain the 
two-dimensional EXIT plot, we assume that a large enough 
number of iterations is performed within the decoder of the 
outer MPCC before iterating with the decoder of the inner 
accumulator. Then, since all component encoders of the outer 
MPCC are identical, I%g™% c is just equal to if xr Finally, 
the convergence behavior of the type 1 TTC can be tracked 
by displaying in a single plot the two EXIT functions in (l39l) . 
The EXIT charts of type 2, type 3, and type 4 TTCs can be 
computed in a similar way. Note that for type 3 and type 4, the 
EXIT function of the outer MPCC also depends on 7 through 
encoder Co, which is directly connected to the channel. For 
the type 2 TTC, the computation of xmpcc ^ s a ^ m ore 
complex, since the EXIT function of the first encoder in the 
outer MPCC is different. 

In Fig. [9] we show the EXIT charts of the rate R = 1/4 
type 1 (triangles) and type 4 (solid curves with no markers) 
TTCs with 2-state component encoders for A = 1. A vertical 
step between the lower curves and the upper curves represents 
a single activation of the inner decoder, while a horizontal 
step between the upper curves and the lower curves represents 
an unspecified number of activations of all the component 
decoders of the MPCC until nothing more can be gained. We 
observe that the type 4 TTC converges significantly earlier 
(7 = 1.03 dB) than the type 1 TTC (7 = 2.24 dB), thanks 
to the systematic branch. Note also that the EXIT chart for 
the type 1 tuned turbo code is identical to that of the R 4 AA 
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0.1 0.2 0.3 0.4 0.5 0.6 0.7 O.I 

l A (C b ); l E (C a ) 

Fig. 9. EXIT charts of the type 4 TTC with A = 1 and 7 = 1.03 dB 
(solid curves with no markers), the type 1 TTC with A = 1 and 7 = 2.24 
dB (triangles), and the type 1 TTC with A = 0.3 and 7 = 1.09 dB (circles). 
R= 1/4, 2-state component encoders. 



code, where the EXIT function of encoder C a in the figure 
corresponds now to the EXIT function of the repeat-by-four 
code. The convergence threshold of the type 1 TTC can be 
significantly improved if some of the parity bits at the output of 
the inner encoder are replaced by bits from the outer MPCC, at 
the expense of a smaller asymptotic minimum distance growth 
rate. For the type 1 TTC with A = 0.3 (circle^]) a tunnel opens 
at 7 = 1.09 dB, i.e., 1.15 dB earlier. In this case, the type 1 
TTC with A = 0.3 has a similar convergence threshold and 
asymptotic growth rate as the type 4 TTC with A = 1. 

VI. Tuning Behavior 

In this section we combine the minimum distance results of 
Section HV] and the iterative decoding convergence results from 
Section [Vj We observed the tuning effect, namely asymptotic 
minimum distance growth rates and iterative decoding thresh- 
olds increasing with A, for all types of tuned turbo codes. 
However, the effectiveness of tuning depends on the specific 
combination of distance and threshold results. 

Fig. |T0l shows the asymptotic minimum distance growth 
rate p versus the iterative decoding convergence threshold 
for the type 4 TTC with 2-state and 4- state encoders in the 
outer MPCC, respectively. For all curves, we computed 11 
equally spaced values from A = to A = p. For R = 1/4 
(p = 1) and A = 1, the ensemble with 4-state encoders 
exhibits an asymptotic distance growth rate of p = 0.17 
and a threshold of E^/No = 1.8 dB. Decreasing A leads to 
better convergence properties, but also to a reduction of the 
asymptotic distance growth rate. In the extreme case of A = 0, 

^ote that the EXIT function of the outer MPCC for type 1 TTCs is 
identical for A = 1 and A = 0.3, since it does not depend on A. 
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Fig. 10. Asymptotic minimum distance growth rate p versus the iterative 
decoding convergence threshold for the type 4 TTC with 2-state and 4-state 
encoders in the outer MPCC. 



the code is equal to the outer MPCC consisting of a parallel 
concatenation of three RCEs and a systematic branch. In this 
case, the minimum distance does not grow linearly with block 
length and the asymptotic distance growth rate therefore is 
zero. Note that the outer MPCC with 4-state encoders has a 
significantly better iterative decoding convergence threshold 
(E h /N = -0.04 dB) than the MPCC with 2-state encoders 
(E h /N = 0.63 dB). For A = 1, the R = 1/4 2-state ensemble 
exhibits a better threshold (E h /N = 1.03 dB) but a lower 
asymptotic distance growth rate (p = 0.1179) than the 4-state 
ensemble. Therefore the dynamic range over which the 2-state 
ensemble can be adjusted is only 0.4 dB, whereas the 4-state 
ensemble can be tuned over a larger range of thresholds and 
asymptotic distance growth rates. This indicates that in the 
design of TTCs it is important to use an outer MPCC with 
very good convergence properties. 

Puncturing TTCs to rate R = 1/3 (p = 2/3) results in 
a right shift of the curves, while leaving their general shape 
intact. Since the maximum asymptotic distance growth rates 
(for A = p) of the underlying R = 1/4 code ensembles are 
not very close to the GVB, they are only slightly reduced by 
the puncturing process (see also Fig. [5]). 

In contrast to Fig. [lOl which shows the values for the 
threshold and the asymptotic distance growth rate directly, in 
Fig. [TT] we show the gap between the convergence threshold 
and channel capacity and the gap between the asymptotic 
minimum distance growth rate and the GVB. Since p = 
for A = 0, the gap of the leftmost point of any curve is equal 
to the GVB. As A increases, the gap to the GVB decreases, but 
the gap to channel capacity increases in all cases. For R = 1/4 
and A = 0, the 2-state type 2 and type 3 ensembles are 
identical. Due to the FFCE, they exhibit an iterative decoding 
threshold of E h /N = -0.04 dB, only 0.75 dB from capacity. 
For A > 0, the two ensembles exhibit somewhat different 
characteristics. 

For p = 1 (R = 1/4) and A = 1, the type 2 ensemble 
has an asymptotic distance growth rate of p = 0.1793, 
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Fig. 11. Gap of the threshold to channel capacity versus the gap of the 
asymptotic minimum distance growth rate to the GVB for 2-state type 2 
and type 3 TTCs and rates R = 1/2, 1/3, and 1/4. As a comparison, for 
R = 1/2 the thresholds and asymptotic distance growth rate coefficients of 
some regular LDPC code ensembles, as well as the ARJA ensemble |23 1 are 
also given. 



corresponding to a gap of 0.0352 to the GVB, and a threshold 
of E\)/No = 2.05 dB, corresponding to a gap to capacity 
of 2.85 dB, while the type 3 ensemble exhibits a gap to the 
GVB of 0.0869 and a gap to capacity of 2.08 dB, which is 
similar to the type 2 ensemble with A = 0.6. While puncturing 
the code ensembles resulted in a right shift of the curves in 
Fig. [lOl in the representation of Fig. ITTI puncturing moves the 
curves closer to the origin, i.e., for a fixed gap to capacity, 
the gap to the GVB is smaller. It is interesting to note that for 
A = the gap to capacity of the type 2 ensemble increases 
slightly as the rate increases, while for the type 3 ensemble the 
gap to capacity decreases slightly as the rate increases. The 
asymptotic distance growth rates for the R = 1 /2 type 2 TTC 
behave like those shown in Fig. [4] for type 1 ensembles. For 
small values of A they rapidly increase and then flatten out as 
the asymptotic distance growth rate approaches the GVB. The 
iterative decoding threshold, however, continuously increases 
with A, so that the tuning behavior of the R = 1/2 type 2 
ensemble flattens for a stretch before it reaches the GVB at 
A = fi = 1/2. Therefore the parameter range over which the 
ensemble can be effectively tuned is from A = 0toA = 0.2, 
which brings the asymptotic distance growth rate to within 
0.02 of the GVB. 

As a comparison we also give the threshold and asymptotic 
distance growth rates for rate R = 1/2 regular LDPC code 
ensembles and the rate R = 1/2 ARJA |23l ensemble. 
With the exemption of the (3,6) LDPC code ensemble, for 
a given gap to channel capacity, the LDPC code ensembles 
exhibit a larger asymptotic distance growth rate than the TTC 
ensembles. However, in contrast to the asymptotically good 
LDPC codes, TTCs have a simple encoder structure with 
0(1) encoding complexity. On the other hand, the quasi-cyclic 
subensemble of the above LDPC codes that also has 0(1) 
encoding complexity is not asymptotically good. 

Fig. El again shows the tuning behavior of the 2-state 
type 3 ensemble, but this time the y-axis shows the relative 
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Fig. 12. Gap of the threshold to channel capacity versus the relative gap 
of the asymptotic minimum distance growth rate to the GVB for the 2-state 
type 3 TTC ensemble with rates R = 1/2, 1/3, and 1/4. 




DC 10" 



10" 










0.2 




0.4 




0.6 




0.8 




1 



0.5 



1.5 

E./N in dB 

b 



2.5 



Fig. 13. Frame error rate performance of R = 1/4 (/x = 1) type 2 TTCs 
with 2-state component encoders for different values of the tuning parameter 
A. 



distance from the GVB, namely 1 



The slopes of 



the three curves are almost identical. Therefore improving the 
asymptotic distance growth rate from zero to half of the GVB 
in each case corresponds to a difference in the convergence 
threshold of roughly 1 dB. The curves plot the maximum 
possible range of A values, with A = corresponding to the 
topmost point and A = fi corresponding to the lowest point of 
each curve. 

VII. Simulation Results 

While the previous sections focused on asymptotic results 
for the minimum distance and the iterative decoding conver- 
gence behavior, in this section we show simulation results 
illustrating that the tuning principle also applies to relatively 
short block lengths. We did not make any attempt to optimize 
the simulated codes but rather focused on the ensemble 
average code performance. To this end, random interleavers, as 
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E b /N (dB) 

Fig. 14. Frame error rate performance of R=l/2 type 4 TTCs with 4-state 
component encoders for different values of the tuning parameter A. 

well as random puncturing patterns, were employed. Carefully 
designing the interleavers and puncturing patterns should yield 
better codes than the ones shown here in terms of error floor 
performance |3H . Interleaver design, however, usually has 
little influence on the iterative convergence threshold. The 
information block length for all simulations is K = 1024 bits 
and we use 20 iterations. 

In Fig. [131 we display frame error rate (FER) curves for rate 
R = 1/4 type 2 tuned turbo codes with 2-state component 
encoders and A G [0,1]. The type 2 code with A = performs 
best in the waterfall region, but it has a high error floor due to 
its poor minimum distancqS In this case, the code is equivalent 
to the MPCC in US). On the other hand, the code with A = 1 
shows the worst convergence, but according to the analysis 
in Section [IVl it has the best asymptotic minimum distance 
growth rate, potentially resulting in the lowest error floor. By 
tuning A, we can obtain any behavior in between these two 
extreme cases: when A decreases, the convergence behavior of 
the code improves (the curves get closer to the performance of 
the MPCC), but the error floor is higher. For small values of 
A, where the minimum distance is small, the simulations were 
able to reach the error floor of the code. Compared to A = 0, 
the code with A = 0.2 loses about 0.5 dB in the waterfall 
region but the height of the error floor improves by two orders 
of magnitude. For A = 0.4, the convergence threshold is again 
0.5 dB worse than the A = 0.2 case, but the error floor is 
lowered beyond what can be observed in the simulations. 

Similar behavior is observed in Fig. [141 where FER curves 
for rate R = 1/2 type 4 TTCs with 4-state component 
encoders are shown. Again, by varying the tuning parameter A, 
we can obtain any behavior between the outer MPCC, which 
shows the best iterative decoding convergence behavior, and 

2 The height of the error floor of the MPCCs (A = 0) in Figs. [13] and 
n~4l is accurately predicted by the union bound of the code, indicating that 
the dominant cause of decoding error is decoding to a wrong codeword. For 
A > 0, the error floor is above the union bound, indicating that the minimum 
pseudo-weight of the code is limiting performance in the error floor region. 



the HCC, which has the best error floor. In particular, the 
code with A = performs best in the waterfall region, as 
predicted by the EXIT charts. However, it has the highest error 
floor, in agreement with the minimum distance analysis. In 
general, lower error floors are obtained for increasing values 
of A, but at the expense of poorer performance in the waterfall 
region. Note that, due to the more powerful 4-state component 
encoders employed, the error floors of the R = 1/2 type 4 
TTCs are lower than those observed in Fig.[l3]for the R = 1/4 
type 2 TTCs with 2-state component encoders. 

VIII. Conclusions 

In this paper, we have introduced a family of hybrid concate- 
nated codes where a tradeoff between asymptotic minimum 
distance growth rate and iterative decoding threshold can be 
achieved by varying a tuning parameter A. By decreasing A, the 
convergence behavior of the code is improved at the expense 
of a smaller asymptotic minimum distance growth rate and 
worse error floor performance, and vice versa. An important 
advantage of the hybrid tuned turbo code constructions is that 
they are asymptotically good for a large range of values of A, 
so that even small values of A are sufficient to ensure linear 
asymptotic distance growth with block length, potentially 
resulting in low error floors. In addition, a second tuning 
parameter n can be used to change the rate of a TTC ensemble, 
thereby allowing a system designer to trade off between code 
rate, iterative decoding convergence behavior, and error floor 
performance without changing the encoder structure. 

Appendix A 
Proof of Proposition [2] 

A sequence on, i = 0, 1, . . . , n, is logarithmically concave 

if 

o?i > Qii-i • a i+ i 

holds for every element oti with 1 < i < n — 1 1321 . 
1) For the accumulator, we now consider the ratio 

Rw lp Acc(iVc) 1 pAcc(iV c ) 
r w,h-l r w,h+l 

N c -h N c -h-[w/2\+l 
~N c -h + l ' N c -h - [w/2\ 
h - 1 h-\w/2]+l 
~li h-\w/2] 

Since the ratio -^r • > 1 for x\ > X2, we obtain 
Ri = 1 for w = 1 and R w > 1 for w > 1. The sequence 
is thus logarithmically concave. Since the logarithm is a 
monotonically increasing function, the maximum of the 
IOWD equals the maximum of the asymptotic IOWD 
and can thus be obtained by taking the derivative of 
(fT2l) . which is given by 

so the maximum occurs at f3 = 1/2, where f^y 2 = 0- 
Correspondingly, the IOWD of the accumulator is max- 
imized for h = Nc/2. 
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2) For simplicity, we consider the terminated 2- state FFCE 
with even output weight h. (Considering the terminated 
code does not change the asymptotic IOWD of the code.) 
The ratio R w is given by 

2 



F FF(iV c ) F FF(iVc) 
ir w,/i-2 ir w,h+2 

ft/2 + 1 N c -w- ft/2 + 1 w- ft/2 + 1 



> 1. 



ft/2-1 Nc — w — ft/2 — 1 w- ft/2-1 

The sequence is strictly logarithmically concave since 
every term in the above product is strictly larger than 
one. The derivative of (fT3l) is given by 

d_ 

~df3 



1 /a-0/2 



1 ( l-a-P/2 
2 ln C ^ 



(43) 

so the maximum occurs at f3 = 2a(l — a), where 
/a,2a(i-a) = °- Correspondingly, the IOWD of the 2- 
state FFCE is maximized for ft = 2k; (1 — w/Nq). 
3) For random puncturing, we consider the ratio 



Rh 



p p(ivo F P(N') 

ft 7 + 1 AJV - ft' + 1 



ft 7 A7V - ft' 
ft - ft' + 1 (1 - \)N - ft + ft' + 1 



> 1. 



ft - ft' (1 — X)N — ft + ft' 

The sequence is strictly logarithmically concave since 
every term in the above product is strictly larger than 
one. The derivative of (ITU) is given by 



_d_ 

df3> 



In 



+ln 



/3-A/3' 



1 - A - /3 + A/3' 



so the maximum occurs at f3' = /?, where /? 



0. 



Correspondingly, the IOWD of the random puncturing 
operation is maximized for ft' = Aft. 

Appendix B 
The Total derivative for F x 

We bound the total derivative of 

Fl = I H (a) + ^ + if£ + + /Ac % 

as p p — >> 0. 

To capture the dependency of p p on the normalized input 
weight a, the normalized output weight of the 2- state FFCEs 
pi and the normalized weight of the systematic branch po, 
we parameterize a as a = ap r , with a G [0,2], where the 
range of a follows from the fact that the output weight of 
the accumulator cannot be less than half the input weight. 
Likewise we parameterize pf = ba = abp r , with b G [0,2]. 
With the above parameterization, the weights p p and p r are 
related by a multiplicative factor, i.e., p p = p r (J + ab(q — 

J))/q. 

We parameterize the output weight of the optional parallel 
encoder as po = ca = acp r , where c = if there is no 



parallel encoder, c = 1 if there is a simple systematic branch, 
and c G [0,2] if the parallel encoder is the 2-state FFCE. 
The total derivative w.r.t. p p is then given by 



Fi| a=ap r 

dpp pf=abp r 
po=acp r 



d 

dp? 



J + ab(q — J) 
d _ dp{ 
dpi dp r 



9 F jl d p 9a 
9p S/?r 



a,=ap r 

p i =abp r 
p =acp r 



The derivatives of the asymptotic IOWDs of the component 
encoders with respect to their output weight are given by (l42l) 
and (l43l) . The derivatives with respect to their input weight are 
given by 



g ^»Acc 

da Ja ' p 



2 



/3 -a/2 



1 



2 



l-P-a/2 
1 — a 



= -ln (4x(l-x)), 



where x 



1-/3 ' 



In 2 



(44) 



and 



— f FF -21nf^— 



We now evaluate the contributions of the component en- 
coders in Fi to the total derivative and show that for p p — >> 0, 
or equivalently p r — >> 0, the contribution of each component 
is either zero or negative. For convenience, for the component 
encoders of the outer MPCC and the systematic branch we 
consider the derivative w.r.t p Y rather than the derivative w.r.t. 
Pp. When the parallel encoder is simply a systematic branch, 
its contribution to the total derivative is a constant. When the 
parallel encoder is the 2-state FFCE, its contribution to the 
total derivative is given by 



2b d FF | da Zq d FF , dp 

q da '^ ul po=acp r dp v q dpo '^ ul po=acp r (jp T 

'1 — ap r — acp r /2 



q 

In 
In 

loa 



In 

ap 



1 — ap r 



1 - ap, 
ap r (l-c/2) 



Inac 

+ 


In ^ 


J 2g 





1 — apr — acpr/2 



1 — apr 



In 



acpr/2 



In 



ap r y \ 1 — ap r 
(l-apr) 1 -/ 2 



In 



acpr/2 
apr 



1 



<c + x ^ / l-ap r (l + c/2) 

,2 / \ 1 — «Pr 
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For a = 0, the above expression takes on the value zero. For 
any fixed a, < a < 2, term 1 is zero for c = 2 and tends to 
— oo otherwise. Term 2 is zero for c = and strictly negative 
otherwise, and it vanishes as p r —> 0. Terms 3 and 4 are 
constants and are zero for c = and c = 2. 

Similarly, the contribution of the FFCEs in the outer MPCC 
to the total derivative is given by 



J d 



da Ja ' pf 
a(q - 



I da 

I a = Ci Pr Tj 

Pf=abp T Op x 



J) 



-6/2 



J 9 , FF . dpi 
(ap r ) 



1-6/2 



ap r 



U-6/2 



I- 1 



In 



In 



l-apr(l + 6/2) 



1 — ap r 



2 V2 



and either tends to zero or — oo as p r —> 0. 

The contribution of the RCEs in the outer MPCC to the 
total derivative is given by 

J 



aJ 



^_ ^Acc 
«/ a,p r 



ap r 



1 - ap 
— ap r /2 



ap r 



^ + /Acc 

ipr dp r dp r q a 

1 /pr(l-a/2) 

2 I 1 — ap r 



In 2 



Pr I a=ap r 



J 

Q L 

J 
9 



In 



In 



1 — p r — ap r /2 
p r - ap r /2 



"In i 

2 Va(l 



4(ap r ) x 



-2/J 



ap^ 1 



-2/J 



a 

- In 

2 



l-p r (l + a/2) 
1 — ap r 



In 



1-0,(1 + a/2) 



For a = 0, the above expression is zero. For any fixed a, 
< a < 2, and J > 2, term 1 tends to — oo as p r — >> 0. Terms 
2 and 3 vanish for p r — > and term 4 is a constant. 

Finally, the contribution of the inner accumulator to the total 
derivative is given by 



® fAcc 



' Pp,Ps 



-In (4a; (1 



x)), 



(46) 



-Pp/2 



, which is negative for all x < 1/2, or 



with x = 

i-pp 

equivalently p s < 1/2. 

Thus, using p s < pj (RqX) and the fact that (l46l) is concave 
in x, for any < p < p < RqX/ 2, we have 



< - In 



dp p ''^^ - 2 ~ 



1 



P 



-c 2 , 



where we have used the fact that, for p p 0, x —> p s . 
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